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\^ ' We present two new algorithms for solving the All Pairs Shortest Paths (APSP) problem for weighted 

directed graphs. Both algorithms use fast matrix multiplication algorithms. 
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Abstract 



The first algorithm solves the APSP problem for weighted directed graphs in which the edge weights are 
integers of small absolute value in 0(n-^+^) time, where fi satisfies the equation uj{l,fi, 1) = 1 + 2fi and 
io{l, II, 1) is the exponent of the multiplication of an n x n'^ matrix by an x n matrix. Currently, the 
C/3 , best available bounds on a;(l,/i, 1), obtained by Coppersmith, imply that /i < 0.575. The running time 

of our algorithm is therefore 0(?t.^-^^^). Our algorithm improves on the 0(n'^'^+'^)/^) time algorithm, 
where u; — 1, 1) < 2.376 is the usual exponent of matrix multiplication, obtained by Alon, Galil and 
Margalit, whose running time is only known to be 0{n^'^^^). 

The second algorithm solves the APSP problem almost exactly for directed graphs with arbitrary non- 
negative real weights. The algorithm runs in 0{{n'^ /e) \og{W/e)) time, where e > is an error parameter 
and W is the largest edge weight in the graph, after the edge weights are scaled so that the smallest 
I non-zero edge weight in the graph is 1. It returns estimates of all the distances in the graph with a 

■ stretch of at most 1 + e. Corresponding paths can also be found efhciently. 

O 
O 



1 Introduction 



The All Pairs Shortest Paths (APSP) problem is one of the most fundamental algorithmic graph problems. 
Ci I The complexity of the fastest known algorithm for solving the problem for weighted directed graphs with 
arbitrary real weights is 0{mn + n^logn), where n and m, respectively, are the number of vertices and 



edges in the graph. This algorithm is composed of a preliminary step, due to Johnson [Joh77|, in which 
cycles of negative weight are found and eliminated, and a nonnegative weight function that induces the 
same shortest paths is found. The algorithm then proceeds by running Dijkstra's single source shortest 



paths algorithm (Dijkstra [ pij59| ]), implemented using Fibonacci heaps (Fredman and Tarjan [ FT87] ]), from 



each vertex of the graph. For a clear description of the whole algorithm see Gormen, Leiserson and Rivest 
|CLR90i , Chapters 21, 25 and 26. 



For directed graphs with nonnegative edge weights, the running time of the above algorithm can be reduced 
to 0{m*n+'n? logn), where m* is the number of edges that participate in shortest paths (Karger, Koller and 



*A preliminary version of this paper appeared in [Zwi98|. 
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Phillips [1KKP93| , and McGeoch |McG95|). For undirected graphs with nonnegative integer edge weights, 
a running time of 0{mn) can be obtained by running a recent single source shortest paths algorithm of 
Thorup Tho99|,[ p?ho00| ] from each vertex of the graph. 

The running time of all the above mentioned algorithms may be as high as Q{n^). Can the APSP problem 
be solved in sub-cubic time? Fredman [ [Fre76 | showed that the APSP problem for weighted directed graphs 
can be solved non-uniformly in 0(n^'^) time. More precisely, for every n, there is a program that solves the 
APSP problem for graphs with n vertices using at most 0(n^'^) comparisons, additions and subtractions. 
But, a separate program has to be used for each input size. Furthermore, the size of the program that 
works on graphs with n vertices may be exponential in n. Fredman used this result to obtain a uniform 
algorithm that runs in 0(n^((loglogn)/logn)^/^) time. Takaoka [frak92 | slightly improved this bound to 
0(n'^((loglogn)/logn)^/^). These running times are just barely sub-cubic. 

The APSP problem is closely related to the problem of computing the min/plus product, or distance 
product, as we shall call it, of two matrices, A = (uij) and B = (bij) are two n x n matrices, then their 
distance product C = A-kB is an n x n matrix C = (cij) such that Cij = min^^-^ {fflifc + ^fcj}i for 1 < i, j < n. 
A weighted graph G = {V, E) on n vertices can be encoded as an n x n matrix D = (dij) in which dij is 
the weight of the edge (i, j), if there is such an edge in the graph, and dij = +00, otherwise. We also let 
da = 0, for 1 < z < n. It is easy to see that D", the n-th power of D with respect to distance products, 
is a matrix that contains the distances between all pairs of vertices in the graph (assuming there are no 
negative cycles). The matrix can be computed using [log2 ?^] distance products. It is, in fact, possible 
to show that the distance matrix can be computed in essentially the same time required for just one 
distance product (see | AIIU74 |, Section 5.9). 

Two nxn matrices over a ring can be multiplied using 0{n^) algebraic operations, where uj is the exponent 
of square matrix multiplication. The naive matrix multiplication algorithm shows that uj < 3. The best 
upper bound on w is currently uj < 2.376 (Coppersmith and Winograd [ |CW9C| ]). The only lower bound 
available on uj is the naive lower bound uj > 2. Unfortunately, the fast matrix multiplication algorithms 
cannot be used directly to compute distance products, as the set of integers, or the set of reals, is not a 
ring with respect to the operations min and plus. 

Alon, Gahl and Margaht | |AGM97| ] were the first to show that fast matrix multiplications algorithms can 
be used to obtain improved algorithms for the APSP problem for graphs with small integer edge weights. 
They obtained an algorithm whose running time is 0{n^^~^'^^^'^) Q for solving the APSP problem for directed 
graphs with edge weights taken from the set {—1,0, 1}. Galil and Margalit | GM97a | , | GM97b| ] and Seidel 
|^ei95 |, obtained 0{n^) time algorithms for solving the APSP problem for unweighted undirected graphs. 
Seidel's algorithm is much simpler. The algorithm of Galil and Margalit has the advantage that it can be 
extended to handle small integer weights. The running time of their algorithm, when used to solve the 
APSP problem for undirected graphs with edge weights taken from the set {0, 1, . . . , M}, is 0{M^^~^^'^/'^n^). 
An improved time bound of 0{Mn^) for the same problem was recently obtained by Shoshan and Zwick 
PZ99| . 

In this paper we present an improved algorithm for solving the APSP problem for directed graphs with 
edge weights of small absolute value. The improved efficiency is gained by using bridging sets and by 
using rectangular matrix multiplications instead of square matrix multiplications, as used by Alon, Galil 
and Margalit [ AGM97 |. It is possible to reduce a rectangular matrix multiplication into a number of 
square matrix multiplications. For example, the task of computing the product of an n x m matrix by an 
m X n matrix is easily reduced to the task of computing {n/m)'^ products of two m x m matrices. The 
running time of our algorithm, if we use this approach, is 0{n^^^^'^^~^^), which is 0(n^'^^^), if we use the 

^Throughout the paper, 0{f(n)) stands for 0{f{n) log"^ n), for some c > 0. 
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estimate uj < 2.376. However, a more efficient implementation is obtained if we compute the rectangular 
matrix multiplications directly using the fastest rectangular matrix multiplication algorithms available. 
The running time of the algorithm is then 0(n^"'"'^), where satisfies the equation 1) = 1 + 

where Ca;(1, /i, 1) is the exponent of the multiplication of an n x matrix by an x n matrix. Currently, 
the best available bounds on a;(l,/x, 1), obtained by Coppersmith | Cop97]] and by Huang and Pan |HP98|, 



imply that /x < 0.575. The running time of our algorithm is therefore 0{n ), and possibly better. 

If w = 2, as may turn out to be the case, then the running time of both our algorithm and the algorithm of 
Alon, Galil and Margalit, would be 0{n?'^). However, the running time of our algorithm may be 0(n^'^) 
even if u; > 2. To show that the running time of our algorithm is 0(n^'^) it is enough to show that 
^, 1) = 2, i.e., that the product of an n x n^/^ matrix by an n^/^ x n matrix can be performed in 
0{in?) time. Coppersmith |Cop97] showed that the product of an n x n^-"^^^ by an n'^'^^^ x n matrix can 
be computed in O(n^) time. 



The algorithm of Alon, Galil and Margalit |AGM97] can also handle integer weights taken from the set 



{— M, . . . , 0, . . . , M}, i.e., integer weights of absolute value at most M. The running time of their algorithm 
is then 0(M('^-i)/2n(3+'^)/2), if M < n^'i-^'^ and 0(Mn(5^-3)/(a.+i))^ jf ^(3-<^)/(c^+i) < Takaoka 
|Tak98] obtained an algorithm whose running time is 0(Mi/3„(6+<^)/3-)^ rpj^g bound of Takaoka is better 



than the bound of Alon, Galil and Margalit for larger values of M. The running time of Takaoka's algorithm 
is sub-cubic for M < n^~'^. 

Our algorithm can also handle small integer weights, i.e., weights taken from the set {— M, . . . , 0, . . . , M}. 
If rectangular matrix multiplications are reduced to square matrix multiplications, then the running time 
of the algorithm is 0{M^^^^''^'^n'^^^^^^~'^^). This running time is again sub-cubic for M < v?^^ but, for 
every 1 < M < n^""^ the running time of our algorithm is faster than both the algorithms of Alon, Galil 
and Margalit and of Takaoka. The running time is further reduced if the rectangular matrix multiplications 
required by the algorithm are computed using the best available algorithm. If M = n*, where t < 3— w, then 
the running time of the algorithm is 0(n^^^(*^), where fi = n(t) satisfies the equation a;(l,/i, 1) = 1 + 2// — 

The new algorithm for solving the APSP problem for graphs with small integer weights is extremely simple 
and natural, despite the somewhat cumbersome bounds on its running time. We already noted that to 
compute all the distances in a weighed graph on n vertices represented by the matrix D it is enough to 
square the matrix D about log2 n times with respect to distance products. It turns out that if we are 
willing to repeat this process, say, log3/2 n times, then in the i-th iteration, instead of squaring the current 
matrix, it is enough to choose a set Bi of roughly = (2/3)*n columns of the current matrix and multiply 
them by the corresponding rui rows of the matrix. In fact, a randomly chosen set of about rrii columns 
would be a good choice with a very high probability! We have thus replaced the product of two n x n 
matrices in the z-th iteration by a product of an n x rrij matrix by an rrii x n matrix. 

To convert distance products of matrices into normal algebraic products we use a technique suggested in 
| AGM97[| (see also Takaoka [[Tak98i ), based on a previous idea of Yuval | Yuv76|| . Suppose that A = (uij) 



and B = (bij) are two nxn matrices with elements taken from the set {— M, . . . , 0, . . . , M}. We convert A 
and B into two nxn matrices A' = (a-^) and B' = {b[j) where a'^j = (n + 1)^^""'^ and b'^j = (n + . 
It is not difficult to see that the distance product of A and B can be inferred from the algebraic product 
of A' and B' (see the next section). We pay, however, a high price for this solution. Each element of A' 
and B' is a huge number that about M log n bits, or about M words of log n bits each, are needed for its 
representation. An algebraic operation on elements of the matrices A' and B' cannot be viewed therefore 
as a single operation. Each such operation can be carried out, however, in 0(M log n) time. We would 
have to take this factor into account in our complexity estimations. 

^In general, uj{r,s,t) is the exponent of the multiphcation of an n" x n*^ matrix by an x n* matrix. 
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Our results indicates that it may be possible to solve the APSP problem for directed graphs with small 
integer weights uniformly in 0(n^'^) time. Even if this were the case, there would still be a gap between 
the complexities of the directed and undirected versions of the APSP problem. As mentioned, the APSP 



for undirected graphs with small integer weights can be solved in 0{n^) time, as shown by Seidel | Sei95 | 
and by Gahl and Margaht [|GM97a| , 1GM97b|1 . (See also Shoshan and Zwick [|Z9|.) 



We next show that the gap between the directed and the undirected versions of the APSP problem can be 
closed if we are willing to settle for approximate shortest paths. We say that a path between two vertices 
i and j is of stretch 1 + e if its length is at most 1 + e times the distance from i to j. It is fairly easy to see 
that paths of stretch 1 + e between all pairs of vertices of an unweighted directed graph can be computed 
in 0{n^ /e) time. (This fact is mentioned in [ GM97a|] ). Stretch 2 paths, or at least stretch 2 distances, for 



example, may be obtained by computing the matrices A^"^ , for 1 < r < [log2 n], where A is the adjacency 
matrix of the graph, and Boolean products are used this time. 

We extend this result and obtain an algorithm for finding stretch 1 + e paths between all pairs of vertices of 
a directed graph with arbitrary non-negative real weights. The running time of the algorithm is 0{{n^ /e)- 
log(VF/e)), where W is the largest edge weight in the graph after the edge weights are scaled so that the 
smallest non-zero edge weight is 1. Our algorithm uses a simple adaptive scaling technique. It is observed 



by Dor, Halperin and Zwick [DHZOO] that for any c > 1, computing stretch c distances between all pairs 
of vertices in an unweighted directed graph on n vertices is at least as hard as computing the Boolean 
product of two n/3 x n/3 matrices. Our result is therefore very close to being optimal. 

Algorithms for approximating the distances between all pairs of vertices in a weighted undirected graph 



were obtained by Cohen and Zwick [CZ97]. They present an 0(n ) algorithm for finding paths with 
stretch at most 3, an 0(n'^/^) algorithm for finding paths of stretch 7/3, and an 0(n^/^m-'^/^) algorithm for 
finding paths of stretch 2. The algorithms of Cohen and Zwick [|CZ97[| use ideas obtained by Aingworth, 



Chekuri, Indyk and Motwani [ ACIM99| ] and by Dor, Halperin and Zwick | DIIZO0| ] who designed algorithms 



that approximate distances in unweighted undirected graphs with a small additive error. As can be seen 
from their running times, these algorithms are all purely combinatorial. They do not use fast matrix 
multiplication algorithms. It is also observed in DHZO0| ] that for any 1 < c < 2, computing stretch c 



distances between all pairs of vertices in an unweighted undirected graph on n vertices is again at least as 
hard as computing the Boolean product of two n/3 x n/3 matrices. For e < 1, our algorithm is therefore 
close to optimal even for undirected graphs. 

The rest of the paper is organized as follows. In the next section we present an algorithm that uses 
fast matrix multiplication to speed up the computation of distance products. In Section ^ we introduce 
the notion of witnesses for distance products. Such witnesses are used to reconstruct shortest paths. In 
Section Q we present a simple randomized algorithm for solving the APSP problem in directed graphs with 
small integer weights. In Section ^ we introduce the notion of bridging sets and explain how the randomized 
algorithm of the previous section can be converted into a deterministic algorithm, if the input graph is 
unweighted. A deterministic algorithm for weighted graphs is then given in Section |^. In Section ^ we 
present the new algorithm for obtaining an almost exact solution to the APSP problem for directed graphs 
with arbitrary non-negative real weights. Finally, we end in Section |9| with some concluding remarks and 
open problems. 

2 Distance product of matrices 

We begin with a definition of distance products. 
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algorithm dist-prod(^, B, M) 

if Mn'^(^''''i) < 
then 



{m + l)^-"^^ if \aij\ < M 
otherwise 



5/. ^ |(m + l)^-^»^ if <M 
'■^ I otherwise 

C ^ fast-prod(A',B') 

2M - Llog(^+i) c^J if > 
+00 otherwise 
else 

Cij ^ min^^i {aik + bkj} ,1 < i, j < n . 
endif 
return C 



Figure 1: Computing the distance product of two matrices. 

Definition 2.1 (Distance products) Let A be annxm matrix and B be anmxn matrix. The distance 
product of A and B, denoted A-k B, in an n x n matrix C such that 

m 

dj = minjajA; + bkj} , for l<i,j<n. 

k=l 

In this definition, and in the rest of the paper, we use the convention that matrices are denoted by upper 
case letters, and that the elements of a matrix are denoted by the corresponding lower case letter. 

The distance product of A and B can be computed naively in 0{n'^m) time. Alon, Galil and Mar- 
galit |AGM97] ] (see also Takaoka p^akOSI ]) describe a way of using fast matrix multiplication, and fast 



integer multiplication, to compute distance products of matrices whose elements are taken from the set 
{— M, . . . , 0, . . . , M} U {+00} . The running time of their algorithm, when applied to rectangular matrices, 
is 0{Mn^'^^'^'^^), where m = n^. Here 0{n^^^''^'^^) is the number of algebraic operations required to com- 
pute the standard algebraic product of an n x matrix by an x n matrix. We see, therefore, that the 
running time of this algorithm depends heavily on M. For large values of M the naive algorithm, whose 
running time is independent of M, is faster. 

Algorithm dist-prod, whose description is given in Figure ||, uses the faster of these two methods to 
compute the distance product of an n x m matrix A and an m x n matrix B whose elements are integers. 
We let m = . Elements in A and B that are of absolute value greater than M are treated as if they 
were +00. (This feature is used by the algorithms described in the subsequent sections.) Algorithm 
fast-prod, called by dist-prod, computes the algebraic product of two integer matrices using the fastest 
rectangular matrix multiplication algorithm available, and using the Schonhage-Strassen | SS71[| (see also 
I AHU74| ] ) algorithm for integer multiplication. 



Lemma 2.2 Algorithm dist-prod computes the distance product of an nx matrix by an xn matrix 
whose finite entries are all of absolute value at most M in 0(mm{Mn^^^''^''^\n'^~^'^}) time. 

Proof: If n^^^ < Mn'^^^''''^) then dist-prod computes the distance product of A and B using the naive 
algorithm that runs in 0{n'^~^'^) time and we are done. 
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Assume, therefore, that Mn'^^^'^''^^ < m?'^'^ . To see that the algorithm correctly computes the distance 
product of A and B in this case, note that for every 1 <i,j < n we have 

m 
k=l 



where indices k for which an. = +00 or bkj = +00 are excluded from the summation, and therefore 

m 

dj = mm {aik + bkj} = 2M - Llog(„+i) c^^J • 



We next turn to the complexity analysis. If Mn^'-^''"'^^ < n^^^' then fast-prod performs 0{n^^^'^'^^) arith- 
metical operations on 0(M log n)-bit integers. The Schonhage-Strassen integer multiplication algorithm 
multiplies two fc-bit integers using O (A; log /c log log A;) bit operations. Letting k = 0(M log n), we get that 
the complexity of each arithmetic operation is 0(M log n). Finally, the logarithms used in the computa- 
tion of Cij can be easily implemented using binary search. The complexity of the algorithm in this case is 
therefore 0{Mn'^^^'^'^^), as required. □ 

There is, in fact, a slightly more efficient way of implementing fast-prod. Instead of computing the 
product of A' and B' using multiprecision integers, we can compute the product of A' and B' modulo 
about M different prime numbers with about logn bits each and then reconstruct the result using the 
Chinese remainder theorem. This reduces the running time, however, by only a polylogarithmic factor. 

What is known about uj{1, r, 1), the exponent of the multiplication of an n x n'" matrix by an n'" x n matrix? 
Note that u; = uj{1, 1, 1) is the famous exponent of (square) matrix multiplication. The best bound on lu 
is currently uj < 2.376 (Coppersmith and Winograd |CW9[l(| ). It is easy to see that a product of an n x 
matrix by an n*" x n matrix can be broken into n'^^^~^^ products of n*" x matrices, and can therefore 
by computed in 0(n^''"''^'^"^^) time. It follows, therefore, that u;(l,r, 1) <2 + r{uj — 2). Better bounds are 
known, however. Coppersmith |Cop97|] showed that the product of an n x 7x0.294 Ynaiiix by an n^-'^^^ x n 
matrix can be computed using O(n^) arithmetical operations. Let a = sup{ < r < 1 : a;(l,r, 1) = 
2 -|- 0(1)}. It follows from Coppersmith's result that a > 0.294. Note that if = 2 -|- o(l), then a = 1. An 
improved bound for uj{l,r, 1), for a < r < 1 can be obtained by combining the bounds 0^(1, 1, 1) < 2.376 



and ui{l,a, 1) = 2 -|- o(l). The following lemma is taken from Huang and Pan [HP 



Lemma 2.3 Let uj = lj(1, 1, 1) < 2.376 and let a = sup{ < r < 1 : u;(l, r,l) = 2 + o(l)} > 0.294. Then 

2 + 0(1) i/0<r<a, 
S I 2 + ^(r-a)+o(l) ifa<r<l. 



Note that the upper bound on a;(l, r, 1) given in Lemma 2.3 is a piecewise linear function. (See Figure |5| in 



Section Q.) Another well known fact (see, e.g.. Pan [Pan85] or Burgisser, Clausen and Shokrollahi | BCS97| ) 



regarding matrix multiplication, used in later sections, is the fact that u;(r, s, t), the exponent of computing 
the product of an rf x n" matrix and an n'^ x n* matrix, does not change if the order of its arguments is 
change. In particular: 

Lemma 2.4 a;(l, 1, r) = uj{1, r, 1) = uj{r, 1, 1). 

In other words, the cost of computing the product of an n x n*" matrix by an n'' x n matrix, and the cost 
of computing the product of an n x n matrix by an n x n''~ matrix are asymptotically the same. 
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3 Witnesses for distance products 



Next, we introduce the notion of witnesses for distance products of matrices. Witnesses for distance 
products are used to reconstruct shortest paths. 

Definition 3.1 (Witnesses) Let A be an n x m matrix and B he an mx n matrix. An n x n matrix W 
is said to be a matrix of witnesses for the distance product C = A-k B if for every 1 < i, j < n we have 
1 < Wij < m and Cij = ai^^^. + b^^.^j. 



Using ideas of Seidel | Sei95 |, GaUl and Margaht [ GM93(| and Alon and Naor |AN96], it is easy to extend 



algorithm dist-prod so that it would also return a matrix of witnesses. The running time of dist-prod 
would increase by only a polylogarithmic factor. The details are sketched below. 

There is a simple, but expensive, way of computing witnesses for the distance product C = A-kB, where A 
is an n X m matrix, and i? is an m x n matrix. Let A' = (a'^j) and B' = {h[j) be matrices such that 
a[j = maij + j — 1 and bj^ = mbji, for every 1 < i < n and 1 < j < m. If we compute the distance product 
C' = A'-kB', then [C'/mJ is the distance product of A-kB and (C mod m) + 1 is a corresponding matrix of 
witnesses. Furthermore, all the witnesses in this matrix are the smallest possible witnesses. The drawback 
of this approach is that the entries of A and B are multiplied by m and this may slow down the operation 
dist-prod by a factor of m, which may be a huge factor. 

There is, however, a much more efficient way of finding witnesses. We show, at first, how to find witnesses 
for elements that have unique witnesses. For 1 < k < m and 1 < i < [log2 m] + 1, we let biti{k) be the 
^-th bit in the binary representation of k. (For concretness, assume that biti{k) is the least significat bit 
in the representation of A;.) For 1 < I < [log2 rri \ + 1, let = {1 < /c < m [ biti{k) = 1}. We also need the 
following definition which is also used in subsequent sections: 

Definition 3.2 (Sampling) Let A be annxm matrix, and let I C {1, 2, . . . , m}. Then, /] is defined 
to be the matrix composed of the columns of A whose indices belong to I. Similarly, if B is an m x n 
matrix, then B[I,*] is defined to be the matrix composed of the rows of B whose indices belong to I. 

To find witnesses for all elements of A = B -k C that have a unique witness, we compute the O(logm) 
distance products Ce = A[*, Ii] -k B[l£,*], for 1 < i < [log2 m] + 1. Let Ci = (c-^^). It is easy to see 

that c\j = Cij, if and only if there is a witness for Cij whose i-th bit is 1. If Cij has a unique witness Wij, 
then these conditions can be used to identify the individual bits in the binary representation of Wij, and 
hence Wij itself. Note that we do not have to know in advance whether Cij has a unique witness. We just 
reconstruct a candidate witness Wij and then check whether Cij = Oi^Wij + bwijj- 

What do we do with elements that have more than one witness? We use sampling. For every 1 < r < 
logm, we choose s = clogn random subsets Rri, ■ ■ ■ , Rrs of {1,2,... ,m} of size m/2'". For every such 
random set Rrt, where 1 < r < logm and 1 < t < s, we try to find unique witnesses for the product 
A[*, Rrt] * B[Rrt, *]■ When such a witness is found, we check whether it is also a witness for the original 
distance product A-kB. A simple calculation, identical to a calculation that appears in Seidel |Sei95|, 



shows that if the constant c is taken to be large enough, then with very high probability, we will find in 
this way witnesses for all positions. 

The above discussion gives a randomized algorithm for computing a matrix of witnesses for the distance 
product Ak: B. The randomized algorithm uses 0(log'^ n) ordinary distance products of matrices of equal 
or smaller size. The resulting algorithm can be derandomized using the results of Alon and Naor [AN96|. 
We thus obtain: 
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7\ /r r 1 7 1 7 / 1 T 

M <— maxj cijj : dij 7^ +oo| 




for £ <— 1 to [log3/2 ^T-l do 




begin 




s - (3/2)^ 




B ^ rand({l, 2, . . . , n}, (9 In n) /s) 




(i^ , KV j ^ aist-proa(i^ i^J, [i?, *J, 


sM) 


"fOT PVPTV 1 <C ? 7 <^ 77 do 

-L J- Vw* V V— ' J- ^ V ^ 1 ^ 1 V 




if < fij then /ij ^ ; Wij ^ 6^/^ 


endif 


end 




return (F, VF) 





Figure 2: A randomized algorithm for finding shortest paths. 



Lemma 3.3 An extended version of algorithm dist-prod computes the distance product of an n x 
matrix by an rf x n matrix whose finite entries are all of absolute value at most M , and a corresponding 
matrix of witnesses, in 0{m.m.{Mri^^^''^'^\n?^'^}) time. 

In the sequel, we let {C^W) <— dist-prod(A, M) denote an invocation of the extended version of 
dist-prod that returns the product matrix C and a matrix of witnesses W . 

4 A randomized algorithm for finding shortest paths 

A simple randomized algorithm, rand-short-path, for finding distances, and a representation of shortest 
paths, between all pairs of vertices of a directed graph on n vertices in which all edge weights are taken 
from the set {— Af, . . . , 0, . . . , M} is given in Figure |2[ 

The input to rand-short-path is an n x n matrix D that contains the weights (or lengths) of the edges 
of the input graph. We assume that the vertex set of the graph is y = {1, 2, . . . , n}. The element dij is 
the weight of the directed edge from i to j in the graph, if there is such an edge, or +00, otherwise. 

Algorithm rand-short-path starts by letting F D. The algorithm then performs [log3/2 n] iterations. 
In the ^-th iteration it lets s <— (3/2)^. It then uses a function called rand to produce a random subset B 
of F = {1, 2, . . . , n} obtained by selecting each element of V independently with probability p = (9 In n) /s. 
If P > 1, then rand returns the set V. The algorithm then constructs the matrices F[*,B] and F[B,*]. 
The matrix F[*,B] is the matrix whose columns are the columns of F that correspond to the vertices of B. 
Similarly, F[B,*] is the matrix whose rows are the rows of F that correspond to the vertices of B (see 
Definition |3.2| and Figure |3|). It then computes the distance product F' of the matrices i?] and *] 
by calling dist-prod, putting a cap of sM on the absolute values of all the entries that participate in the 
product. The call also returns a matrix W' of witnesses. Finally, each element of F' is compared to the 
corresponding element of F. If the element of F' is smaller, then it is copied to F and the corresponding 
witness from W' is copied to W. (By 6^/ we denote the wlj-th. element of the set B.) 

Let S{i,j) denote the (weighted) distance from i to j in the graph, i.e., the smallest weight of a directed 
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Figure 3: Replacing the square product F -k F hy the rectangular product F[*, B] ★ F[B, *]. 

path going from i to j. The weight of a path is the sum of the weights of its edges. The following lemma 
is easily established: 

Lemma 4.1 At any stage during the operation o/ rand-short-path, for every i,j G V, we have: 
(i) fij > Sii,j)- 

(a) Ifwij = then fij = dij. Otherwise, 1 < Wij < n and fij > fi^^,.. + fwijj- 

(Hi) IfS{i,j) = S{i, k)+S{k,j) and if in the beginning of some iteration we have fik = S{i, k), f^j = S{k,j), 
\fik\j \ fkj\ ^ and k E B, then at the end of the iteration we have fij = S{i,j). 

Proof: Property (i) clearly holds when F is initialized to D. In each iteration, the algorithm chooses a 
set B and then lets 

fij ^ min{ fik + fkj\keB, \ fik\, \fkj\ <sM} 
fij ^ min{ fij , fij } 

for every i.j £ V . For every k, we have fik + fkj > k) + 5{k,j) > 5{i,j), as follows from the induction 
hypothesis and the triangle inequality, and thus the new value of fij is again an upper bound on 6{i,j). 

Property (ii) also follows easily by induction. Initially, fij = dij and Wij = 0, for every i,j G V, so the 
condition is satisfied. Whenever fij is assigned a new value, we have 1 < Wij < n and fij = fi^wij + fwijj- 
Until the next time fij is assigned a value we are thus guaranteed to have fij > f\wij + fwijj, as the value 
of fij does not change, while the values of fi^wij and fwijj ™ay only decrease. 

Finally, if the conditions of property {Hi) hold, then at the end of the iteration we have 

fij < fij < fik + fkj = S{i,k) +d{k,j) = 6{i,j) . 
As fij > S{i,j), by property (i), we get that fij = S{i,j), as required. □ 
More interesting is the following lemma: 
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Figure 4: The correctness proof of rand-short-path. 

Lemma 4.2 Let s = (3/2)^, for some 1 < £ < riog3/2 n] . With very high probability, if there is a shortest 
path from i to j in the graph that uses at most s edges then at the end of the £-th iteration we have 
fij = Khj)- 

Proof: We prove the lemma by induction of £. It is easy to check that the claim holds for £ = 1. We 
show next that if the claim holds for ^ — 1, then it also holds for £. Let i and j be two vertices connected 
by a shortest path that uses at most s = (3/2)^ edges. Let p be such a shortest path from i to j. If the 
number of edges on p is at most 2s/3 then, by the induction hypothesis, after the {i — l)-st iteration we 
already have fij = 5(i,j) (with very high probability). Suppose, therefore, that the number of edges on p 
is at least 2s/3 and at most s. To avoid technicalities, we 'pretend' at first that s/3 is an integer. We later 
indicate the changes needed to make the proof rigorous. 

Let I and J be vertices on p such that / and J are separated, on p, by exactly s/3 edges, and such that i 
and /, and J and j are separated, on p, by at most s/3 edges. See Figure Such vertices I and J can 
always be found as the path p is composed of at least 2s/3 and at most s edges. 

Let A be the set of vertices lying between / and J (inclusive) on p. Note that |^| > s/3. Let k A. As k 
lies on a shortest path from i to j, we have S{i,j) = 6{i,k) + 6{k,j). As k lies between / and J, there 
are shortest paths from i to k, and from k to j that use at most 2s/3 edges. By the induction hypothesis, 
we get that at the beginning of the i-th iteration we have fik = S{i,k) and f^j = 6{k,j), with very high 
probability. We also have \ fik\, \ fkj\ ^ sM. It follows, therefore, from Lemma |4.1| (iM), that if there exists 
k € AnB, where B is the set of vertices chosen at the ^-th iteration, then at the end of the ^-th iteration 
we have fij = 6{i,j), as required. 

What is the probability that AnB ^ (pi Let p = (9 In n)/s. If p > 1, then B = V and clearly 
AnB ^ (f). Suppose, therefore, that p = (91nn)/s < 1. Each vertex then belongs to B independently with 
probability p. As 1^41 > s/3, the probability that AD B = (j) is at most 

(l_^)"%e-*" = „-3. 

As there are less than n? pairs of vertices in the graph, the probability of failure during the entire operation 
of the algorithm is at most • = 1/n. (We do not have to multiply the probability by the number 
of iterations, as each pair of vertices should only be considered at one of the iterations. If a pair i,j G V 
violates the condition of the lemma, then it also does so at the ^-th iteration, where £ is the smallest integer 
such that there is a shortest path from i to j that uses at most s = (3/2)^ edges.) 

Unfortunately, s/3 is not an integer. To make the proof go through, we prove by induction a slight 
strengthening of the lemma. Define the sequence sq = 1 and S£ = [3s^_i/2], for ^ > 0. Note that 
se > (3/2)^. We show by induction on £ that, with high probability, for every i,j € V, if there is a shortest 
path from i to j that uses at most S£ edges, then at the end of the ^-th iteration we have fij = 6{i,j). 
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The proof is almost the same as before. If p is a shortest path from i to j that uses at most si edges, we 
consider vertices / and J on p such that / and J are separated by exactly [s^/2j edges, and such that i 
and /, and J and j are separated by at most edges. Repeating the above arguments we obtain a 

rigorous proof of the (strengthened) lemma. □ 

Combining Lemmas and f4.2| with the fact that each pair of vertices in a graph of n vertices is connected 
by a shortest path that uses less than n edges, assuming there are no negative cycles in the graph, we get 
that after the last iteration, F is, with very high probability, the distance matrix of the graph. Furthermore, 
either S{i,j) = dij, or Wij lies on a shortest path from i to j. This is stated formally in the following lemma: 



Lemma 4.3 If there are no negative weight cycles in the graph, then after the last iteration of rand- 
short-path, with very high probability, for every i,j^V we have 

(i) fij = Hhj)- 

(ii) If Wij = then 5{i,j) = dij. Otherwise, 1 < Wij < n and 5{i,j) = 5{i,Wij) + 5{wij,j). 



Proof: Condition (i) follows, as mentioned, from Lemma |4.2| , the fact that in the last iteration s > n, 
and the fact that if 5{i,j) < +oo, and if there are no negative weight cycles in the graph, then there is a 
shortest path from i to j that uses at most n — 1 edges. 



Suppose now that fij = S{i,j) < dij. By Lemma i.l[ii) we get that after the last iteration we have 
1 < Wij < n and fij > fi^unj + fwijj, or equivalently, 5{i,j) > 5{i,Wij) + 6{wij,j). But, by the triangle 
inequality we have 6{i,j) < 5{i,Wij) + 5{wij,j). Thus, 5{i,j) = 5{i,Wij) + 5{wij,j), as required. □ 

It is also easy to see that the input graph contains a negative cycle if and only if fa < for some 1 < i < n. 
If there is a path from i to j that passes though a vertex contained in a negative cycle, we define the 
distance from i to j to be — oo. Using a standard method, it is easy to identify all such pairs in 0{n^) 
time. See Galil and Margalit [|GM97b| ] for the details. 



The matrix W returned by rand- short- path contains a succinct representation of shortest paths between 
all pairs of vertices in the graph. Ways for reconstructing these shortest paths are described in the next 
section. 

What is the complexity of rand-short-path? The time taken by the i-th iteration is dominated by the time 
needed to compute the distance product of an n x m matrix by an m x n matrix, where m = 0{{n log n)/s), 
with entries of absolute value at most sM using dist-prod. If we assume that s = n^^^' and M = n^, 
then according to Lemma 2^, this time is 0{mm{n^^'^^^''^'^^^^^~'^\n?~^^}). Graphs of the best available 



upper bounds on the functions uj{l,r, 1) and uj{l,r, 1) + (1 — r) are given in Figure |5|. (Also shown there 
is the function 2 + r.) Note that a;(l,r, 1) + (1 — r)is decreasing in r while 2 + r is increasing in r. The 
running time of an iteration is maximized when t + Lo{l,r, 1) + (1 — r) = 2 + r, or equivalently, when 
a;(l,r, 1) = 1 + 2r — t. As there are only O(logn) iterations, we get 



Theorem 4.4 Algorithm rand-short-path finds, with very high probability, all distances in the input 
graph, and a succinct representation of shortest paths between all pairs of vertices in the graph. If the input 
graph has n vertices, and the weights are all integers with absolute values at most M = n*, where t < 3 — cj, 
then its running time is Oiv?^^^^^), where fi = //(t) satisfies w(l,/x, 1) = 1 + 2/x — 

If M > n^^'^ then fast matrix multiplication algorithms are never used by the algorithm and the running 
time is then O(n^). 
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Figure 5: Best available bounds on the functions a;(l, r, 1) and ^(1, r, 1) + (1 — r), and the function 2 + r. 



Let us look more closely at the running time of the algorithm when M = 0(1). This is the case, for 
example, if all the weights in the graph belong to the set {—1, 0, 1}. The running time of the algorithm of 
Alon, Galil and Margalit in this case is 0{n^^~^^^/'^), which is about 0(n^'^^^). The running time of the new 
algorithm is 0(n^+'^), where /x satisfies io{l, /x, 1) = 1 + 2/i. Using the naive bound uj{l, r, 1) < 2 + (w — 2)r, 



we get that /i < < 0.616. Using the improved bound of Lemma 2.3, we get that fi < 



uj+2a~4 



< 0.575. 



Corollary 4.5 Algorithm rand-short-path finds, with very high probability, all distances, and a succinct 
representation of shortest paths between all pairs of vertices in the graph on n vertices in which all the 
weights are taken from the set {—1,0, 1} in 0(n^'^^^) time. 



5 Constructing shortest paths 

A simple recursive algorithm, path, for constructing shortest paths is given in Figure |[ If there are no 
negative weight cycles in the graph, and if W is the matrix of witnesses returned by a successful run of 
rand-short-path, then path(iy, z, j) returns a shortest path from i to j in the graph. If Wij = 0, then the 
edge {i,j) is a shortest path from i to j. Otherwise, a shortest path from i to j is obtained by concatenating 
a shortest path from i to Wij, found using a recursive call to path, and a shortest path from Wij to j, found 
using a second recursive call to path. (The dot in next to last line in the description of path is used to 
denote concatenation.) If there is no directed path from i to j in the graph, then path(VF, i,j) returns the 
"edge" (i,j) whose weight is +oo. 

Theorem 5.1 If there are no negative weight cycles in the input graph, and ifW is the matrix of witnesses 
returned by a successful run o/ rand-short-path, then path(W^,i,j) returns a shortest path from i to j in 
the graph. The running time o/ path(iy, i, j) is proportional to the number of edges in the path returned. 

Proof: For every i,j G V , let tij be the number of the iteration of rand-short-path in which fij was 
set for the last time. If fij = dij, let tij = 0. We need the following claim: 

Claim 5.2 If 1 < Wij < n, then ti^^.^tw^^j < tij. 
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algorithm path(W,i, j) 

if Wij = then 

return 
else 

return path(VK, i, Wij) . path(W, Wij,j) 
endif 



Figure 6: Constructing a shortest path using a matrix of witnesses. 



Proof: Suppose that fij was set for the last time at the i-th iteration. Let /^^ be the elements of the 
matrix F at the beginning of the i-th iteration, and f^g be these elements at the end of the ^-th iteration. 
By our assumption and by Lemma we get that 

f ■ • = f -i. = fP -I- f ■ 

fij = = S{i,Wij) + 6{wij,j) . 

As fi^yj^j > S{i,Wij) and f°.^ j > 5{wij,j) (see Lemma we get that f^^^.. = S{i,Wij) and f^^. j = 

6{wij,j). Thus, fi,w^^ and fwijj stice already assigned their final values at the beginning of the ^-th iteration, 
and therefore ti^w^jitwij,j < i = tij, as required. □ 



We now prove Theorem ^ by induction on tij. If tij = 0, then Wij = 0, and path(M^, returns the 
edge which is indeed a shortest path from i to j. Suppose now that path(W,i, j) returns a shortest 
path from r to s for every r and s for which trs < Suppose that tij = £. By Claim we get 
that ti^Wij,twij,j < By the induction hypothesis, the recursive calls path{W, i,Wij) and path{W, Wij , j) 
return shortest paths from i to Wij and from Wij to j. As S{i,j) = 6{i,Wij) + 6{wij,j) (Lemma [4.3| ), the 
concatenation of these two shortest paths is indeed a shortest path from i to j, as required. □ 

There is, however, something unsatisfying with the behavior of path. While it is true that the call 
path(l^, always returns a shortest path from i to j in the graph, the shortest path returned is not 
necessarily simple, i.e., it may visit certain vertices more than once. This may happen, of course, only if 
there are zero weight cycles in the graph. It is, of course, easy to convert a non-simple shortest path into 
a simple shortest path, by removing cycles, but the running time then is no longer proportional to the 
number of edges on the shortest path produced. 

Another possible objection to the use of path is that it cannot produce shortest paths in real time. While 
it is true that a shortest path that uses £ edges can be found in 0{i) time, it may also take time just 
to find the second vertex on such a path. 

To address these two issues, we show next that the matrix of witnesses W returned by rand-short-path 



can be easily converted into a matrix of successors (see, e.g., | CLR90 |, Chapter 25, were predecessors, 
instead of successors are considered). A matrix of successors can be easily used to construct trees of 
shortest paths. 



Definition 5.3 (Successors) A matrix S is a matrix of successors for a graph G = {V,E) if for every 
i,j G V, if there is a path from i to j in the graph, then the call s-path(S, i,j), where s-path is the 
procedure given in Figure returns a simple shortest path from i to j in the graph. 
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algorithm s-path(5', j) 

if Sij = j then 

return 
else 

return {i, Sij) . s-path(S', Sij,j) 
endif 



Figure 7: Constructing a shortest path using a matrix of successors. 



algorithm wit-to-suc(M^, T) 

for £ ^ to max(T) do Tg ^ { \ Uj = ^ } 

for every (i, j) G To do Sij ^ j 

f or ^ ^ 1 to max(T) do 
for every € do 
begin 

k <— Wij 

while Sij = do Sij ^ Sik ; j ^ Sij 

end 

return S 



Figure 8: Constructing a matrix of successors. 

Algorithm wit-to-suc, given in Figure receives a matrix W of witnesses returned by rand-short-path, 
and a matrix T that gives the iteration number in which each element of W was set for the last time, as 
in the proof of Theorem |5.1| . (It is very easy, of course, to modify rand-short-path so that it would also 
return this matrix.) It returns a matrix S of successors. Algorithm wit-to-suc works correctly even if 
there are zero weight cycles in the graph, but not if there are negative weight cycles in the graphs as then 
distances and shortest paths are not well defined. 

Theorem 5.4 If there are no negative weight cycles in the graph, ifW is the matrix of witnesses returned 
by a successful run of rand-short-path, and if T is the corresponding matrix of iteration numbers, then 
algorithm wit-to-suc returns a matrix of successors. The running time of algorithm wit-to-suc is 0{n^). 

Proof: Algorithm wit-to-suc begins by initializing all the elements of the n x n matrix S to 0. It then 
constructs, for each iteration number i, the set Ti of pairs {i,j) for which tij = i. It is easy to construct 
all these sets in 0{n'^) by bucket sorting. (In the description of wit-to-suc, max(T) denotes the maximal 
element in T. Note that max(T) = O(logn).) Next, for every {i,j) such that tij = 0, it sets Sij ^ j. It 
then performs max(T) iterations, one of each iteration of rand-short-path in which values are changed. 
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We prove, by induction on the order in which the elements of the matrix S are assigned nonzero values, 
that if Sij 7^ 0, then s-path(S', i, j) returns a simple shortest path from i to j in the graph. This clearly 
holds after wit-to-suc sets Sij <— j for every G Tq, as the edge is then a simple shortest path 
from i to j in the graph. 

Suppose that wit-to-suc is now about to perform the while loop for a pair for which tij = i. If 
Sij 7^ 0, then no new entries are assigned nonzero values. Suppose, therefore, that Sij = 0. Let k = Wij. By 
Claim 5^, we get that tik < i and ,tkj < i- Thus, Sik and Skj are already assigned nonzero values and by 
the induction hypothesis, the calls s-path{S, i,k) and s-path(S, k,j) return simple shortest paths in the 
graph from i to k, and from k to j. Let v be the first vertex on the path s-path(S', i, k) for which s^j ^ 0. 
The vertex v is well defined as s^j 7^ 0. As s„j 7^ 0, we get, by the induction hypothesis, that s-path(5, j) 
traces a simple shortest path from v to j. The concatenation of the portion of s-path(S', i, fc) from i to f , 
and of s-path(S', w, j) is clearly a shortest path from i to j. It is also simple as both portions are simple, 
and as for every u on the first portion, except f , we have Suj = 0, while for every u on the second portion 
we have Suj 7^ 0. After the while loop corresponding to s-path(S', i, j) returns this simple shortest 

path. Furthermore, if s^j is changed by this while loop, then u lies on the first portion of this simple 
shortest path, and s-path(5', u, j) is the corresponding suffix of this simple shortest path, which is also a 
simple shortest path. 

Finally, the complexity of the algorithm is O(n^) as each iteration of the while loop reduces the number 
of zero elements of S by one. □ 



6 A deterministic algorithm for unweighted graphs 

In this section we describe a deterministic version of algorithm rand-short-path of Section The version 
described here works only for unweighted directed graphs. A Slightly more complicated deterministic 
algorithm that works for weighted directed graphs is described in the next section. We start with the 
following useful definition: 

Definition 6.1 {6{i,j) and ri(i,j)) As before, let6{i,j) denote the distance from i to j in the graph, i.e., 
the minimum weight of a path from i to j in the graph, where the weight of a path is the sum of the weights 
of its edges. Let r]{i,j) denote the minimum number of edges on a shortest path from i to j. 

If the graph is unweighted then d{i,j) = rj(i,j), for every i,j E V. Note that rj(i,j) is not necessarily the 
distance from i to j in the unweighted version of the graph. 

Algorithm rand-short-path implicitly used the notion of bridging sets which we now formalize: 

Definition 6.2 (Bridging sets) Let G = {V,E) be a weighted directed graph and let s > 1. ^ set of 

vertices B is said to be an s-bridging set if for every two vertices i,j € V such that rj{i,j) > s, i.e., if 
all shortest paths from i to j use at least s edges, there exists k £ B, such that S{i,j) = 6{i,k) + 6{k,j). 
The set B is said to be a strong s-bridging set if for every two vertices i,j £ V such that rj{i,j) > s, there 
exists k £ B, such that 5{i,j) = 6{i, k) + 6{k,j) and r]{i,j) = r]{i, k) + r]{k,j). 

The difference between bridging sets and strong bridging sets is depicted in Figure ^. All the paths shown 
there, schematically, are shortest paths from i to j although they do not all use the same number of edges. 
If S is a strong s-bridging set, and if rj(i,j) = t and t > s, i.e., if the minimum number of edges on a 
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Figure 9: Bridging and strong bridging sets. 

shortest path from i to j is t, and t > s, then there is a vertex k G B that hes on a shortest path from i 
to j that uses exactly t edges. The top drawing in Figure ^ illustrates the fact there there may be several 
shortest paths from i to j that use exactly t edges. A vertex k belonging to B is guaranteed to lie on at 
least one of them. If B is an s-bridging set, but not necessarily a strong s-bridging set, then a vertex k 
belonging to B is guaranteed to lie on a shortest path from i to j. But, this shortest path may use much 
more than t edges. This is illustrated in the bottom drawing of Figure ^ 

It is not difficult to see that if s is an integer then we can replace the condition r]{i,j) > s in the definition 
of bridging, and strongly bridging, sets by the condition r](i,j) = s. Indeed, suppose the appropriate 
condition holds for every u,v gV such that rj{u,v) = s. Suppose that r]{i,j) =t>s. Consider a shortest 
path p from i to j that uses t edges. Let w be the s-th vertex on p, starting the count from 0. Then, clearly 
r]{i, w) = s. Thus, a vertex k £ B is guaranteed to lie on a shortest path from i to w. This vertex lies also 
on a shortest path from i to j, or on such a shortest path with a minimum number of edges, as required. 



Reviewing the proof of Lemma 4.2, we see that algorithm rand-short-path produces correct results as 



long as the set B used in the i-th iteration is a strong (s/3)-bridging set. 

Lemma 6.3 If in each iteration of rand-short-path the set B is a strong {s / 3) -bridging set, then all 
distances returned by rand-short-path are correct. 



Proof: The proof is almost identical to the proof of Lemma [4.2| . We show again, by induction on £, that 
if r]{i,j) < (3/2)^, then after the i-th. iteration of the algorithm we have fij = 6{i,j). The basis of the 
induction is easily established. Suppose, therefore, that the claim holds for i — 1. We show that it also 



holds for £. Let i and j be two vertices such that 2s/3 < ri{i,j) < s, where s = (2/3) . As in Lemma 4.2, 
let p be a shortest path from i to j that uses r]{i,j) edges, let / and J be two vertices on p such that I 
and J are separated, on p, by s/3 edges, and such that i and I, and J and j, are separated, on p, by 
at most s/3 edges (see Figure ^). As B, the set used in the £-th iteration, is assumed to be a strong 
(s/3)-bridging set, and as rj{I, J) > s/3, a vertex A; € -B is guaranteed to lie of a shortest path from I to J 
that uses 7]{I, J) edges. This shortest path from / to J is not necessarily the portion of p going from / to J. 
Nonetheless, we still have 5{i,j) = S{i, k) + 6{k, j) and rj{i,j) = rj{i,k) + rj{k,j). As rj{i,k) < r]{i,J) < 2s/3 
and r](k,j) < rj{I,j) < 2s/3 we get, by the induction hypothesis, that fik = 5{i, k) and fkj = 6{k,j). After 
the distance product of the i-th iteration we therefore have fij = 5{i,j), as required. □ 



In the proof of Lemma |6.3| we made heavy use of the assumption that i? is a strong bridging set. If B were 



not a strong bridging set, we could not have deduced that rj{i, k),r]{k,j) <2s/3 and the argument used in 



the proof would break down. Also implicit in the proof of Lemma 4.2 is the following result whose proof 
we do not repeat: 
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algorithm find-bridge(VF, s) 

for every 1 < i,i < n do 

U ^ sub-path(Ty, i, j, s — 1) U {i,j} 
if \U\ > s then C ^CU {U} endif 

end 

B ^ hitting-set(C) 
return B 



Figure 10: A deterministic algorithm for constructing an s-bridging set. 



algorithm sub-path(VF, i,j, s) 

if Wij = or s = then 

return (p 
else 

U ^ sub-path(Ty, i, Wij ,s — 1) 

return U U {wij} U suh-pa.th{W, wij , j , s — \U\ — 1) 
endif 



Figure 11: Finding up to s vertices on a shortest path from i to j. 



Lemma 6.4 Let G = iy^E) he a weighted directed graph on n vertices and let s > 1. If B is a random 
set obtained by running rand({l,2, . . . ,n}, (31nn)/s), i.e., if each vertex ofV is added to B independently 
with probability (3 In n)/s, then with very high probability B is a strong s-bridging set. 



We next describe a deterministic algorithm, called find-bridge, for finding s-bridging sets. (Unfortunately, 
the sets returned by find-bridge are not necessarily strong s-bridging sets.) A description of algorithm 
find-bridge is given in Figure 10. It receives an n x n matrix of witnesses W using which it is possible 
to reconstruct shortest paths between all pairs of vertices i,j(zV for which r](i,j) < s. In other words, if 
vihj) — then path(W,i,j) produces a shortest path from i to j. We assume here, for simplicity, that 
the graph does not contain cycles of non-positive weight so the shortest path produced by path{W,i, j), 
when 'r]{i,j) < s, is simple. We show later how to remove this simplifying assumption. We do not assume 
that the shortest path produced by path(VF,i,j) uses a minimum number of edges, i.e., it may use more 
than r]{i,j) edges. 

Algorithm find-bridge uses a procedure called sub-patii that receives the matrix W, two vertices i,j(zV 
and an integer s. The operation of sub-patli is similar to the operation of path. It tries to construct 
a path from i to j using the witnesses contained in the matrix W. It counts, however, the number of 
intermediate vertices found so far on the path and stops the construction when s intermediate vertices are 
encountered. A simple recursive implementation of sub-path is given in Figure 11. The following lemma 
is easily verified. 



Lemma 6.5 If a call to path(Wi i, j) constructs a simple path from i to j that passes through t intermediate 
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vertices, then suh-path{W, i,j, s) returns the set of intermediate vertices on this path, ift <s, or a subset 
of s intermediate vertices on this path, ift>s. The running time o/ sub-path(l^, i, j, s) is 0{s). 



For every i,j S V, let Utj be the set obtained by adding the vertices i and j to the set obtained by cahing 
suh-path{W,i,j, s). All the elements of Uij are vertices on a shortest path from i to j. If r]{i,j) = s, then 
by our assumption on W, path(W,i, j) returns a shortest path from i to j. This shortest path must use 
at least s edges and contain, therefore, at least s — 1 intermediate vertices. It follows that \Uij\ > s + 1. 
Thus, if a set B hits all the sets Uij for which \Uij\ > s, i.e., ii B Uij ^ (j) whenever \Uij\ > s, then B 
is s-bridging. Algorithm find-bridge collects all the sets Uij for which \Uij\ > s into a collection of sets 
called C. It then calls algorithm hitting-set to find a set that hits all the sets in this collection. 

Algorithm hitting-set uses the greedy heuristic to find a set B that hits all the sets in the collection C. 
As shown by Lovasz |Lov75] and Chvatal [Chv78], the size of the hitting set returned by hitting-set is 
at most (In A) + 1 times the size of the optimal fractional hitting set, where A is the maximal number 
of sets that a single element can hit. As each set in the collection C contains at least s elements, there 
is a fractional hitting set of size n/s. This fractional hitting set is obtained by giving each one of the n 
vertices of ^ a weight of As there are at most sets to hit, we get that A < n?. As a consequence 
we get that find-bridge returns a bridging set of size at most n(21nn + hitting-set can be easily 

implemented to run in time which is linear in the sum of the sizes of the sets in the collection. The running 
time of find-bridge is therefore easily seen to be 0{n?s). We obtained, therefore, the following result: 



Lemma 6.6 // the matrix W can be used to construct shortest paths between all pairs of vertices i,j(zV 
for which r]{i,j) < s, then algorithm find-bridge finds an s-bridging set of size at most n(21nn + l)/s. 
The running time o/ find-bridge is 0{n^s). 



Unfortunately, the sets returned by find-bridge are not necessarily strong bridging sets. But, if the input 
graph is unweighted^ then an s-bridging set is also a strong s-bridging set. Thus, if we replace the call to 
rand in rand-short-path by 

if s < then 

B ^ find-bridge (ly, [s/3j) 
endif 

we obtain a deterministic algorithm for solving the APSP problem for unweighted directed graphs. We call 
this algorithm unwght-short-path. 

We compute new bridging sets only when s < n^/^ as computing bridging sets for larger values of s may 
consume too much time. (Recall that the running time of find-bridge is O(n^s).) The algorithm remains 
correct as an s-bridging set is also an s'-bridging set for every s' > s. The use of a bridging set of size 
e(ni/2 log n) in the iterations for which s > n^/^ does not change the overall running time of the algorithm, 
as in all these iterations the required distance product can be computed using the naive algorithm in 0(n^'^) 
time. We thus get: 



Theorem 6.7 Algorithm unwght-short-path solves the APSP problem for unweighted directed graphs 
deterministically in 0{v?^^) time, where n < 0.575 satisfies ijj{l,fi, 1) = 1 + 2/x. 
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algorithm short-path(D) 

F ■,W ^0 

M ^ max{ \dij \ : dy ^ +00} 

for £ <— 1 to [log2 n] do 
begin 

if s < then 

B ^ find-bridge-upd(F, W,s/2) 
endif 

dist-prod-upd(F, Tl/, B,V,V, sM) 
dist-prod-upd(F, W, V, B, V, 2sM) 

end 

return (F, W) 



Figure 12: A deterministic algorithm for finding shortest paths. 



algorithm dist-prod-upd(F, W, A,B,C, L) 

{F', W) ^ dist-prod(F[^, B],F[B, C],L) 

for every 1 < » < and 1 < j < \C\ do 

if flj < fa„c, then ja,,c, ^ flj ; Wa„c, ^ endif 



Figure 13: A simple procedure for updating distances and witnesses. 



7 A deterministic algorithm for weighted graphs 



In this section we present a deterministic version of algorithm rand-short-path for weighted directed 
graphs. The algorithm, called short-path is given in Figure 12. For simplicity, we assume at first that 
the input graph does not contain negative weight cycles, nor zero weight cycles. 

Algorithm short-path uses a simple procedure, called dist-prod-upd, that performs a distance product, 
by calling dist-prod of Section |2[ and updates the distances and witnesses found so far. Algorithm 
dist-prod-upd is given in Figure It receives the n x n matrices F and W that hold the distances and 
witnesses found so far. It also receives three subsets A,B,C C V, where V = {1,2, . . . ,n} is the set of 
all vertices. (In the calls made by short-path, two of the sets A, B and C would be V.) dist-prod-upd 
computes the distance product F[A, B] -k F[B, C], putting a cap of L of the values of the entries of F that 
participate in the product. It then updates the matrices F and W accordingly. (By F[A, B] we obviously 
mean the submatrix of F composed of the elements whose row index belongs to A, and whose column 
index belongs to B. Also, we let Oj denote the i-th elements of A.) Thus, the first call to dist-prod-upd 
in short-path computes the distance product F[B, *] ★ F, while the second one computes the distance 
product F[*,B] -k F[B,*], as in rand-short-path. By Lemma 2A, we get that the cost of these two 
distance products is essentially the same. 



Algorithm short-path constructs bridging sets by calling algorithm find-bridge- upd given in Figure 14. 
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algorithm find-bridge-upd(F, W, s) 

for every 1 < i, j < n do 

U ^ sub-pa.th-upd{F,W,i, j,i, j, s — 1) U {i,j} 
if \U\ > s then C ^CU {U} endif 

end 

B ^ hitting-set(C) 
return B 



Figure 14: A deterministic algorithm for constructing an s-bridging set while updating some distances. 



algorithm sub-path-upd(i<', W, a, b, i, j, s) 






if Wij = or s = then 






return (p 






else 






if fai ~l~ fi,Wij ^ fa,Wij then fa,Wij ^ fat ~\~ fi,Wij i Wa^Wij ^ 


- i 


endif 


if fwijj + fj,b < fwij,b then fwij,b fwijj + fj,b ) fwij,b ^ 


-j 


endif 


U <— sub-path-upd(F, W, a, b, i, Wij ,s — I) 






return U U {wij} U suh-path-upd{F, W, a, b,Wij,j,s — 


\u 


-1) 


endif 







Figure 15: Finding up to s vertices on a shortest path from i to j while updating distances. 



Algorithm find-bridge-upd is very similar to algorithm find-bridge of Section ^. The difference is that 
find-bridge-upd calls algorithm sub-path-upd, given in Figure 15, instead of algorithm sub-path called 
by find-bridge. 

A call to sub-path(Ty, i, j, s) returns a set of up to s intermediate vertices on a path from i to j. However, 
if A; G suh-path{W,i, j, s), it is not guaranteed that fik,fkj < +oo, let alone fik + fkj < fij- Algorithm 
sub-path-upd fixes this problem. The following lemma is easily verified. 



Lemma 7.1 If the matrices F and W satisfies the conditions fij > 6{i,j), for every i,j € V, and 
fij ^ fi,Wij + fwijj whenever 1 < Wij < n, and if path{W,i, j) traces a path from i to j, then a call 
to sub-path-upd(F, W^, i, j, i, j, s) returns a set of s intermediate vertices on this path, or the set of all 
intermediate vertices if there are less than s of them. If k is one of the vertices returned by the call, then 
after the call we have fit + fkj ^ fij- The matrices F and W continue to satisfy the specified conditions. 
Furthermore, if before the call we have fij = 6{i,j), then after the call to we have fik = 5{i, k), fkj = 6{k,j) 
and 5{i,j) = 5{i, k) + 5{k,j). 



Before proving the correctness of algorithm short-path, we prove a useful additional property of bridging 
sets. 
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at most 




k 



Figure 16: The correctness proof of short-path. 

Lemma 7.2 Let B he an s-bridging set of a graph G = {V,E) with no nonpositive weight cycles. Then, if 
i,j £V and r]{i,j) > s, then there is a vertex k ^ B such that S{i,j) = 5{i, k) + S{k,j) and ri(i, k) < s. 

Proof: By the definition of bridging sets, we get that there exists ki & B such that S{i,j) = 5{i,ki) + 
6{ki,j). If r]{i,ki) < s, we are done. Assume, therefore, that r]{i,ki) > s. Let k[ be next to last vertex 
on a shortest path from i to ki. Clearly, k[ ^ ki, S{i,j) = 5{i, k[) + S{k[,j) and r]{i, k[) > s. Thus, there 
exists k2 & B such that 5{i, k'l) = 5{i, k2) + S{k2, fe'^), and therefore also S{i,j) = 6{i, ^2) + 6{k2,j). There 
is, therefore, a shortest path from i to j that passes through k2, then through k'l, and then through ki. As 
there are no nonpositive weight cycles in the graph, a shortest path must be simple and therefore k2 7^ ki. 
In general, suppose that we have found so far r distinct vertices kr, kr-i, . . . ,ki & B such that there is a 
shortest path from i to j that visits all these vertices. If r]{i,kr) < s, then we are done. Otherwise, we 
can find another vertex k^+i S B, distinct from all the previous vertices, such that there is a shortest path 
from i to j that passes though fer+i, kr, k^-i, . . . ,ki. As the graph is finite, this process must eventually 
end with a vertex from B satisfying our requirements. □ 



Theorem 7.3 Algorithm short-path finds all distances, and a succinct representation of shortest paths 
between all pairs of vertices in a graph with no nonpositive weight cycles. If the input graph has n vertices 
and the edge weights are taken from the set {— M, . . . , 0, . . . , M}, where M = and t < 3 — lv, then its 
running time is 0(n^+^*^*^), where fi = fi{t) satisfies uj{l,fi, 1) = 1 + 2fi — t. 

Proof: We prove, by induction, that after the £-th iteration of short-path we have: 

(i) fij > for every i,j G V. 

(ii) If Wij = then = dij. Otherwise, 1 < Wij < n and fij > fi^u,.^ + fw,j,j- 

(iii) Ifr?(i,j) <2^then/i, = ,5(i,j). 



The proofs of properties (i) and (ii) are analogous to the proofs of properties (i) and (ii) of Lemma 4T 
We concentrate, therefore, on the proof of property (iii). It is easy to check that property (iii) holds before 
the first iteration. We show now that if it holds at the end of the {i — l)-st iteration, then it also holds 
after the ^-th iteration. 

Let i,j G y be such that rj{i,j) < 2^. If r]{i,j) < 2^~^, then the condition fij = 5{i,j) holds already 
after the {£ — l)-st iteration. Assume, therefore, that 2^^^ < ri{i,j) < 2^. Let p be a shortest path from i 
to j that uses r](i,j) edges. Let / be the vertex on p for which r](i,I) = 2^~^. (See Figure |l^.) Note 
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that ??(/, j) < 2 . By the induction hypothesis, after the {i — l)-st iteration we have fn = 6{i,I) and 
fij ~ ^i-^jj)- ^ is 2^~^-bridging set, we get, by Lemma \I.2[ that there exists k £ B such that 
6{i,I) = 6{i,k) +6{k,I) and rj{i,k) < 2^^^. Furthermore, as € sub-path-upd(l^, I, i, I, s/2) U 
we get, by Lemma 0, that fik = 6{i, k) and f^i = 6{k, I). (The fact that fik = k) follows also from the 
induction hypothesis, as rj{i,k) < 2^~^.) As r]{i, I),r]{i,k) < 2^~^, we get that \6{i, I)\,\6{i, k)\ < 2^~^M. 
Thus \5{k,I)\ = \5{i,I) -6ii,k)\ < \6{i,I)\ + \5{i,k)\ < 2^M. To sum up, we have 

fik = 6{i, k) , fki = 6{k,I) , fij = 6{I,j) 
\fik\<2''^M , \fki\<2'M , \fi,\<2^-^M 

As k G B and I,j G V, after the first distance product of the ^-th iteration, we get that 

fkj < fki + fij = S{k,I) + 6{I,j) = 6{k,j) , 

and thus fkj = 5{k,j) and \fkj\ < 2^+^M. As i,j € V and k £ B, after the second distance product we 
get that 

fij < fik + fkj = k) + 6{k,j) = 6{i,j) , 
and thus fij = 5{i,j), as required. □ 

Finally, we describe the changes that should be made to short-path if we want it to detect negative weight 
cycles, and continue to work in the presence of zero weight cycles. Detecting negative weight cycles is easy. 
We simply check, after each iteration, whether fa < 0, for some i G V. Making short-path work in the 
presence of zero weight cycles requires more substantial changes. 

Before describing the changes required, let us review the problems caused by zero weight cycles. First, as 
mentioned in Section |5[ the shortest paths returned by path(PF, are not necessarily simple. Thus, calls 
to sub-path(Ty, i, j, s) and sub-path-upd(Ty, i, j, i, j, s) may return multisets with less than s distinct ele- 
ments. As a consequence, the bridging set returned by find-bridge(VF, s) and by find-bridge-upd(F, W, s) 
are not necessarily of size 0(n log n/s). Second, Lemma |7.2| , that plays a crucial role in the correctness 
proof of algorithm short-path no longer holds in the presence of zero weight cycles. 

To fix these problems we use an approach that is similar to the one used in Section |5|. After each iteration of 
short-path we call algorithm wit-to-suc convert the matrix of witnesses W into a matrix S of successors. 
As the complexity of wit-to-suc is O(n^), the extra cost involved is negligible. Even though W does not 
describe yet shortest paths between all pairs of vertices of the graph, it is not difficult to verify that if for 
some i,j € V the matrix W describes a shortest path from i to j in the graph, then S would describe a 
simple shortest path from i to j. Using S instead of W, it is then easy to find, in 0{s) time, the first s 
intermediate vertices on a shortest path from i to j. The bridging set returned by find-bridge- upd would 
then satisfy the condition of Lemma [7.2| and the correctness of the algorithm would follow. 

8 Almost shortest paths 

In this section we show that estimations with a relative error of at most e of all the distances in a weighted 
directed graph on n vertices with non-negative integer weights bounded by M can be computed determin- 
istically in 0{{n^ /e) ■ logM) time. If the weights of the graphs are non-integral, we can scale them so that 
the minimal non-zero weight would be 1, multiply them by 1/e, round them up and then run algorithm 
with the integral weights obtained. The running time of the algorithm would then be 0{{n^ /e) - logiyV / e)), 
as claimed in the abstract and in the introduction. 
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algorithm scale(A, M, R) 

a'. ^ / /^^^ if < ttij < M 



+00 otherwise 



Return A'. 



Figure 17: A simple scaling algorithm. 



algorithm approx-dist-prod(y4, B, M, R) 

C ^ +00 

for r ^ Uog2-^J to riog2^^1 ^o 
begin 

A' ^ scale(^,2^i^) 
^ scale{B,T,R) 
C ^ dist-prod{A' , B' , R) 
C ^ min{ C , (27i?) • C" } 

end 

return C 



Figure 18: Approximate distance products. 



For unweighted directed graphs, it is easy to obtain such estimates in 0{n^ /e) time. Let A be the adjacency 
matrix of the graph and let e > 0. By computing the Boolean matrices J and ^r(i+<:) 1^ for every 

< ^ < log]^_|_^ n, we can easily obtain estimates with a relative error of at most e. The time required to 
compute all these matrices is 0{n^ /e). We next show that almost the same time bound can be obtained 
when the graph is weighted. The algorithm is again quite simple. 

The main idea used to obtain almost shortest paths is scaling. A very simple scaling algorithm, called 
scale, is given in Figure 17. The algorithm receives an n x n matrix A containing non-negative elements. 
It returns an n x n matrix A'. The elements of A that lie in the interval [0, M] are scaled, and rounded 
up, into the R+\ different values 0, 1, . . . , i?. We refer to R as the resolution of the scaling. 

We next describe a simple algorithm for computing approximate distance products. The algorithm, called 
approx-dist-prod, is given in Figure It receives two matrices A and B whose elements are non- 
negative integers. It uses adaptive scaling to compute a very accurate approximation of the distance 
product of A and B. 



Lemma 8.1 Let C he the distance product of the matrices obtained from the matrices A and B by replacing 
the elements that are larger than M by +00. Let M and R be powers of two. Let C be the matrix obtained 
by calling approx-dist-prod(yl, i?, M, i?). Then, for every i,j we have cij < Cij < (1 + ^)cij- 



Proof: The inequalities Cij < Cij follow from the fact that elements are always rounded upwards by scale. 
We next show that Cij < (1 + ^)cij. Let A; be a witness for Cij, i.e., Cij = a^k + bkj. Assume, without loss 
of generality, that Oj^ < b^j- Suppose that 2*^-*^ < b^j < 2*, where 1 < s < log2 M (the cases b^j = 
and bkj = 1 are easily dealt with separately). If s < log2 i?, then in the first iteration of approx-dist- 
prod, when r = log2 R, we get Cij = Cij. Assume, therefore, that log2 R < s < log2 M. In the iteration of 
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algorithm approx-short-path(I?, e) 

F 

M <— max{ dij : dij ^ +00} 
i?^4[log2 n]/ln(l + e) 

for i 1 to [log2 n] do 
begin 

F' <— approx-dist-prod(F, F, Mn, R) 
F ^ min{ F , F' } 

end 

return F 



Figure 19: Approximate shortest paths. 



approx-dist-prod in which r = s we get that 

— ^ < flifc + , — ^ < Ofcj + ■ 
Thus, after the call to dist-prod we have 

Cij < — ^ + — ^ < ajfc + bkj + < (1 + -^)cij , 

as required. □ 

If A and i? are two n x n matrices, then the complexity of approx-dist-prod is 0{R-n^ - log M). As 
we will usually have R <C M, algorithm approx-dist-prod will usually be much faster than dist-prod, 
whose complexity is 0{M -n^). 



Algorithm approx-short-path, given in Figure 19, receives as input an n x n matrix D representing the 
non-negative edge weights of a directed graph on n vertices, and an error bound e. It computes estimates, 
with a stretch of at most 1 + e, of all distances in the graph. Algorithm approx-short-path starts by 
letting F <— D. It then simply squares F, using distance products, [log2 n\ times. Rather than compute 
these distance products exactly, it uses approx-dist-prod to obtain very accurate approximations of 
them. 

Algorithm approx-short-path uses a resolution R which is the smallest power of two greater than or 
equal to 4[log2 n]/ ln(l + e). Thus, R = 0((logn)/e). Using Lemma it is easy to show by induction 
that the stretch of the elements of F after the £-th iteration is at most (1 + ■^)^. After [log2 n] iterations, 
the stretch of the elements of F is at most 

4\riog2nl / ln(l + e)\r'°S2nl 

RJ V riog2 n\ J 



As R = 0((logn)/e), the complexity of each approximate distance product computed by approx-short- 
path is 0((n'^/e)dogM). As only [log2 n] such products are computed, this is also the complexity of the 
whole algorithm. We have thus established: 
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Theorem 8.2 Algorithm approx-short-path runs in 0((n'^/e) -logM) time and produces a matrix of 
estimated distances with a relative error of at most e. 

As described, algorithm approx-short-path finds approximate distances. It is easy to modify it so that 
it would also return a matrix W of witnesses using which approximate shortest paths could also be found. 



9 Concluding remarks 



The resuhs of Seidel [ pei95| ] and Galil and Margalit |GM97a| ] , pM97b| ] show that the complexity of the 
APSP problem for unweighted undirected graphs is 0{n^). The exact complexity of the directed version of 
the problem is not known yet. In view of the results contained in this paper, there seem to be two plausible 
conjectures. The first is 0{n^'^). The second is 0{n^). Galil and Margalit [ GM97a ] conjecture that the 
problem for directed graphs is harder than the problem for undirected graphs. Proving, or disproving, this 
conjecture is a major open problem. 

Another interesting open problem is finding the maximal value of M for which the APSP problem with 
integer weights of absolute value at most M can be solved in sub-cubic time. Our algorithm runs in sub- 
cubic time for M < n^^^ , as does the algorithm of Takaoka [lakOJ]. Can the APSP problem be solved in 
sub-cubic time, for example, when M = n? 

Finally, we note that the shortest paths returned by the algorithms presented in this paper do not necessarily 
use a minimum number of edges. Producing shortest paths that do use a minimum number of edges seems 



to be a slightly harder problem. For more details, see Zwick [Zwi99| 
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